A note on the ergodic convergence of symmetric alternating proximal gradient method
نویسنده
چکیده
We consider the alternating proximal gradient method (APGM) proposed to solve a convex minimization model with linear constraints and separable objective function which is the sum of two functions without coupled variables. Inspired by Peaceman-Rachford splitting method (PRSM), a nature idea is to extend APGM to the symmetric alternating proximal gradient method (SAPGM), which can be viewed as an extension of APGM by performing an additional intermediate multiplier updating step at each iteration. This note shows that SAPGM possesses an ergodic convergence rate of O(t−1) established under the analytic framework of contraction type methods. The efficiency of the proposed method is verified by solving the stable principal component pursuit problem.
منابع مشابه
An inexact alternating direction method with SQP regularization for the structured variational inequalities
In this paper, we propose an inexact alternating direction method with square quadratic proximal (SQP) regularization for the structured variational inequalities. The predictor is obtained via solving SQP system approximately under significantly relaxed accuracy criterion and the new iterate is computed directly by an explicit formula derived from the original SQP method. Under appropriat...
متن کاملOn non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers
Recently, a worst-case O(1/t) convergence rate was established for the DouglasRachford alternating direction method of multipliers in an ergodic sense. This note proposes a novel approach to derive the same convergence rate while in a non-ergodic sense.
متن کاملExtending the ergodic convergence rate of the proximal ADMM
Pointwise and ergodic iteration-complexity results for the proximal alternating direction method of multipliers (ADMM) for any stepsize in (0, (1 + √ 5)/2) have been recently established in the literature. In addition to giving alternative proofs of these results, this paper also extends the ergodic iteration-complexity result to include the case in which the stepsize is equal to (1+ √ 5)/2. As...
متن کاملThe symmetric ADMM with positive-indefinite proximal regularization and its application
Due to update the Lagrangian multiplier twice at each iteration, the symmetric alternating direction method of multipliers (S-ADMM) often performs better than other ADMM-type methods. In practice, some proximal terms with positive definite proximal matrices are often added to its subproblems, and it is commonly known that large proximal parameter of the proximal term often results in “too-small...
متن کاملFurther Study on the Convergence Rate of Alternating Direction Method of Multipliers with Logarithmic-quadratic Proximal Regularization
In the literature, the combination of the alternating direction method of multipliers (ADMM) with the logarithmic-quadratic proximal (LQP) regularization has been proved to be convergent and its worst-case convergence rate in the ergodic sense has been established. In this paper, we focus on a convex minimization model and consider an inexact version of the combination of the ADMM with the LQP ...
متن کامل